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ANALYSIS  OF  OFFICER  PERFORMANCE  OF  AN 
EXPERIMENTAL  TASK:  OFFICE  MANAGEMENT 


A  comprehensive  longitudinal  research  program  co  improve  iviM  L! 
assignment  of  officers  was  undertaken  by  BESRL  at  the  recommend  a',  ion  i-r 
the  Army  Scientific  Advisory  Panel  and  the  Office  of  the  Deputy  Chief  of 
Staff  for  Personnel.  The  research  was  designed  to  provide  instruments 
and  techniques  for  differential  classification  of  officers  into  three 
broad  job  domains:  combat,  technical,  and  administrative.  ' 

Within  the  broad  research  program,  a  sample  of  iOOQ  officers  was 
administered  a  battery  of  experimental  measures--the  Differential  Officer 
Battery  (DOB) --on  entry  to  active  duty  in  1902  and  lOf'5.  A  sub sample  of 
900,  representative  of  nine  branches  of  service,  was  selected  to  partici¬ 
pate  in  a  special  three-day  situational  exercise  after  they  had  served 
12  to  18  months  on  active  duty.  The  exercise  was  conducted  from  lor 5 
through  early  1965  at  the  Officer  Evaluation  Center  ( OEC)  at  Fort  McClellan, 
Alabama.  Each  officer  was  required  to  perform  15  tasks  typical  of  junior 
officer  duties--five  combat,  five  technical,  and  five  administrative  in 
nature.  The  tasks  were  assigned  in  the  context  of  a  simulated  Military 
Assistance  Advisory  Group  (MAAG)  operating  in  a  friendly  counLry.  A 
simulated  invasion  required  emergency  response  under  field  conditions  of 
simulated  combat  and  guerrilla  activity.  The  situation  provided  consid¬ 
erable  stress  and  pressure  on  the  officer  subjects  who  were  permitted 
little  sleep  during  the  exercise.  An  OEC  staff  of  17  officers  and 
41  enlisted  men  conducted  the  exercise,  functioning  as  actors,  observers, 
and  recorders  of  performance.  Their  recordings  and  evaluations,  along 
with  any  products  required  of  the  officer  subjects,  were  analyzed  to 
yield  dimensions  of  performance  measures  in  each  task.  The  present 
publication  covers  the  analysis  of  data  from  one  of  the  administrative 
tasks  conducted  early  in  the  exercise,  the  Office  Management  task. 


OBJECTIVES 

The  primary  objective  of  the  present  analysis  was  to  discover  the 
dimensions  of  behavior  measured  in  the  Office  Management  task.  Scores 
developed  in  this  analysis  are  to  be  correlated  with  scores  from  the 
other  14  tasks  to  indicate  which  dimensions  are  task  specific,  which 
are  comnon  to  the  administrative  domain,  and  which  are  general  across 
all  performance  domains.  The  scores  will  serve  also  as  criteria  for 
validation  of  predictor  scores  from  the  DOB.  Findings  from  the  overall 
research  program  can  be  applied  to  evaluation  of  junior  officer  performance, 
to  initial  classification  of  officers,  and  to  the  problem  of  early  iden¬ 
tification  and  career  follow-up  of  the  most  promising  potential  leaders. 
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PROCEDURE 


THE  SITUATIONAL  TASK 

The  Office  Management  task  was  designed  to  measure  the  officer’s 
ability  to  analyze  assignment  of  duties,  working  arrangements,  personnel 
records  procedures,  organization  and  flow  charts,  and  to  apply  manage¬ 
ment  principles  in  correcting  improper  office  procedures.  Specifically, 
the  officer  was  instructed  to  recommend  changes  in  the  organization 
chart  and  flow  process  chart  of  the  personnel  office  of  a  host  nation 
unit.  He  was  required  to  realign  sections,  reallocate  personnel,  revise 
administrative  routines,  and  diagnose  deficiencies  in  the  office  operation. 


SAMPLE 

For  the  internal  analysis  reported  here,  only  the  last  735  officers 
of  the  900  examined  in  the  OEC  were  included  in  the  sample.  Data  on 
officers  who  went  through  the  exercise  earlier  were  excluded  because  of 
changes  and  additions  in  recording  and  evaluating  procedures  introduced 
in  the  early  operation  of  the  Center. 


VARIABLES 

Performance  variables  were  obtained  from  three  instruments: 
Organization  Chart  Checklist,  Flow  Process  Chart  Checklist,  and  Deficiency 
Checklist.  These  instruments  contained  29,  31,  and  36  items,  respectively. 
The  Deficiency  Checklist  consisted  of  18  pairs  of  items,  one  set  in  the 
checklist  of  deficiencies  reported,  the  other  in  the  examinee's  markings 
on  the  field  notes. 


ANALYSIS 

The  three  instruments  were  divided  into  a  total  of  seven  sections 
according  to  content.  The  sections  were  subdivided  into  parallel  sets  of 
items  so  that  reliability  of  each  section  could  be  estimated.  Table  1 
shows  the  resultant  set  of  scales.  The  full-length  scales  and  the  total 
scores  on  each  of  the  three  instruments  were  then  intercorrelated.  From 
the  10-variable  matrix,  a  set  of  final  variables  representing  differen¬ 
tiable  aspects  of  performance  and  a  total  score  on  the  task  were  determined 
by  inspection. 


RESULTS 

Table  2  presents  reliability  estimates  for  each  of  the  seven  content 
scales  based  on  Che  Spearman-Brown  correction  of  the  split-half  reli¬ 
ability  coefficients  (Table  5).  All  scales  except  Changes  and  Deletions 
show  adequate  reliability,  ranging  from  .71  to  .91.  Table  3  presents  the 
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correlation  among  the  scales  and  total  score  on  each  instrument.  The  high 
coefficient  (.84)  between  Reported  Deficiencies  and  Identification  on  Notes 
indicated  that  a  single  Deficiency  score  would  suffice. 

Accordingly,  the  nine  content  scale  scores  selected  for  correlation 
with  scores  on  other  tasks  and  validation  of  the  DOB  were:  Identifying 
Functions,  Allocating  Manpower,  Total  Organization  Chart  Checklist  score, 
Sequence  of  Operations,  Changes  and  Deletions,  Retained  Aspects,  Total 
Flow  Process  Chart  Checklist  Score,  a  single  Deficiency  Checklist  Score, 
and  Total  Task  Score.  Total  score  for  the  task  was  made  up  of  the 
unweighted  sum  of  all  the  scale  scores.  Means  and  standard  deviations  of 
the  selected  scales  and  instrument  scores  are  shown  in  Table  4,  intercor¬ 
relation  in  Table  5.  The  Flov  Process  Chart  and  the  Deficiency  Checklists 
receive  slightly  less  than  two-fifths  of  the  weight  in  the  total  score, 
and  the  Organization  Chart  Checklist  slightly  more  than  one-fifth. 

The  scale  scores  and  total  score  derived  from  the  analysis  will  be 
used  for  correlation  with  similarly  derived  scores  from  the  other  14 
situational  tasks  of  the  OEC  exercise,  and  for  validation  of  the  predictors 
of  the  DOB. 
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Table  1 


CONTENT  SCORES  OBTAINED  ON  OFFICE  MANAGEMENT  TASK 


T  ns  t  rumen t 


Content  Score 


No.  of  Items 


Organization  Chart  Checklist 


identifying  Functions: 

<A) 

(B) 


Allocation  of  Manpower: 

(A)  u 

;  B )  10 


Flow  Process  Chart  Checklist  Sequence  of  Operations 

'A) 

B) 

Changes  and  Deletions: 

A) 

B) 

Retained  Aspects: 

(A) 

( B ) 

Deficiency  Checklist  Reported  Deficiencies: 

'A) 

B) 

(C) 

''D) 

Identification  on  Notes: 

( A) 
i  B) 

(C) 

(D) 


5 

2 


4 

2 


10 

10 


c. 

4 

4 

5 

4 

4 


Table  2 


RELIABILITY  OF  CONTENT  CATEGORY  SCALES  (CORRECTED) 


Instrument 

Reliability  Coefficients 

Organization  Chart  Checklist 

Identifying  Functions 

•71 

Allocating  Manpower 

.82 

Flow  Process  Chart  Checklist 

Sequence  of  Operations 

.82 

Changes  and  Deletions 

.21 

Retained  Aspects 

•  91 

Deficiency  Checklist 

Reported  Deficiencies 

.78 

Identification  on  Notes 

.72 

Table  3 

INTERCORRELATIONS*  OF  CONTENT  CATEGORY  SCALES 


Scales  Intercorrelations 


1. 

Identifying  Functions 

1 

2. 

Allocating  Manpower 

15 

2 

3. 

Organization  Chart  Total 

49b 

94b 

1 

4. 

Sequence  of  Operations 

-03 

09 

OO 

± 

5- 

Changes  and  Deletions 

00 

12 

11 

38 

Pj  # 

Retained  Aspects 

01 

09 

05 

63 

40 

6 

7- 

Flow  Process  Chart  Total 

01 

08 

08 

75b 

62b 

95b 

1 

8. 

Reported  Deficiencies 

-04 

18 

14 

09 

13 

06 

09 

8 

0. 

Identification  on  Notes 

-02 

13 

11 

12 

16 

08 

12 

84  2 

10. 

Deficiency  Checklist  Total 

03 

16 

15 

11 

15 

07 

11 

96b  96b  10 

•Decimal  points  omitted 
bPart-whole  correlation  coefficients 


A 


Table  4 

MEANS  AND  STANDARD  DEVIATIONS  ON  SELECTED  SCALES 
OF  THE  OFFICE  MANAGEMENT  TASK 


Scales 

M 

SD 

Identifying  Functions 

6.36 

1.37 

Allocating  Manpower 

12.48 

3.37 

Organization  Chart  Total 

18.84 

3-82 

Sequence  of  Operations 

2.36 

1.45 

Changes  and  Deletions 

4.25 

1.72 

Retained  Aspects 

13.56 

5-02 

Flow  Process  Chart  Total 

20.17 

6.94 

Deficiency  Checklist  Total 

23.70 

7.44 

Total  Task  Score 

62.71 

11.37 
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INTERCORRELATIONS*  OF  VARIABLES  IN  THE  OFFICE  MANAGEMENT  TASK 


